Utilizing Domain Knowledge in Neuroevolution

نویسندگان

  • James Fan
  • Raymond Lau
  • Risto Miikkulainen
چکیده

We propose a method called Rule-based ESP (RESP) for utilizing prior knowledge evolving Artificial Neural Networks (ANNs). First, KBANN-like techniques are used to transform a set of rules into an ANN, then the ANN is trained using the Enforced Subpopulations (ESP) neuroevolution method. Empirical results in the Prey Capture domain show that RESP can reach higher level of performance than ESP. The results also suggest that incremental learning is not necessary with RESP, and it is often easier to design a set of rules than an incremental evolution scheme. In addition, an experiment with some of the rules deleted suggests that RESP is robust even with an incomplete knowledge base. I~ESP therefore provides a robust methodology for scaling up neuroevolution to harder tasks by utilizing existing knowledge about the domain.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Comparison of NEAT and HyperNEAT on a Strategic Decision-Making Problem

Neuroevolution is a useful machine learning approach for problems with limited domain knowledge, but it has not done well with strategic decision-making problems, where the correct action varies sharply as the agent moves across states. Two promising neuroevolution algorithms are NeuroEvolution of Augmenting Topologies (NEAT) and its extension, HyperNEAT. We compare the performance of these two...

متن کامل

Cross-Domain Knowledge Transfer Using Structured Representations

Previous work in knowledge transfer in machine learning has been restricted to tasks in a single domain. However, evidence from psychology and neuroscience suggests that humans are capable of transferring knowledge across domains. We present here a novel learning method, based on neuroevolution, for transferring knowledge across domains. We use many-layered, sparsely-connected neural networks i...

متن کامل

An Interactively Constrained Neuro-Evolution Approach for Behavior Control of Complex Robots

Behavior control of complex technical systems, such as robots, is still a challenging problem. In this context, embodied neuro-control is a bioinspired method to handle these problems, and evolutionary robotics takes up some essential research topics in this field. But for systems with many multimodal sensor inputs and actuating outputs new evolutionary methods have to be applied because the se...

متن کامل

Numerical Optimization with Neuroevolution

Neuroevolution techniques have been successful in many sequential decision tasks such as robot control and game playing. This paper aims at establishing whether they can be useful in numerical optimization more generally, by comparing neuroevolution to linear programming in a manufacturing optimization domain. It turns out that neuroevolution can learn to compensate for uncertainty in the data ...

متن کامل

Incorporating Advice into Evolution of Neural Networks

Neuroevolution is a promising learning method in tasks with extremely large state and action spaces and hidden states. Recent advances allow neuroevolution to take place in real time, making it possible to e.g. construct video games with adaptive agents. Often some of the desired behaviors for such agents are known, and it would make sense to prescribe them, rather than requiring evolution to d...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2003